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What is Virtual Reality? 


Ability of imagination is one of the profound traits of the human psyche which distinguishes us from other or- 
ganisms. Our interminable efforts to reimagine the real world should be considered as an instinctive behavioural 
aspect. How often do we end up indulging ourselves in the virtual realms of daydreams or a fictitious world trig- 
gered by literature or similar stimuli? Our mind, the most intuitive Virtual Reality device, seamlessly simulates 
these explorations which are influenced by the traces of memories developed by virtue of the constant interac- 
tions with the real world. 


Definition 

The term Virtual Reality (VR) is a conjunction of two antonymous words ‘virtual’ and ‘reality’, describing the 
nature of experience which it caters to. VR can be defined as the experience of actually being present in a virtual 
world with the help of a system which makes us believe that we are in a real world. 


Components of VR 


¢ Virtual World: 

Virtual World is an alternative realm which is simulated for the user to experience, by a VR system. The compo- 
nents of the virtual world depend on the purpose for which the world is designed. This imaginative space pro- 
gresses through the ideas of the creator, which is simulated using computer programs. The degree of immersion 
achieved by a VR experience often depends on the ability of the virtual world to respond to the user’s interac- 
tions by constantly updating itself. 


¢ Interaction: 

The believability of any virtual space to be real depends upon its ability to respond to the user’s interactions. 
When a virtual world is presented to us by a system with immense possibilities of interaction, we tend to react 
intuitively to the objects, characters and the space itself. The interactions can be in the form of sensory inputs or 
physical movements with respect to the imaginary space. The computer system which acts as a mediator gathers 
these inputs, analyses them and updates the virtual world accordingly. 


¢ Hardware: 

The hardware comprises of the physical equipment which aids the user to be involved in a VR experience. The 
head mounted display, cameras, and sensors for position tracking are some of the typical examples of hardware 
components. The information regarding the user interactions, often in the form of sensory cues is assessed by 
the hardware and passed on to the computer system (software) which updates the virtual world. 
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¢ Software: 


Software includes the computational components which are used to render and manipulate the virtual world 
according to the user’s interactions with the system. The effectiveness of a virtual world depends on the com- 
putational power of a Graphical Processing Unit which is responsible for rendering the visual representations 
and adding possibilities of interactions. Another parameter decided by the software is called ‘motion to photon 
latency’ which is the time required for the virtual world to update according to the head movement (perspective 
shift) or other sensory interactions. A higher value of this latency can cause adverse effects like motion sickness 
and nausea. 
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Fig 1. An overview of a VR System 
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Related Technologies 

The definitions and explanations of VR and its derivatives are always prone to iterations because of the evolving 
nature of the domain. In 1994, Paul Milgram and Fumio Kishino defined a spectral representation of experiences 
related to VR called Reality-Virtuality Continuum [1]. The spectrum exists between the ideal extremes of a com- 
pletely virtual world and real world keeping the augmented versions of these in between. 
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Fig 2. Adopted from Reality-Virtuality Continuum [1] 


« Mixed Reality: 

The conventional definition of a VR experience refers to when the user is immersed in a completely synthetic 
world with the help of a system. As the technology progressed to cater to different applications, a subclass of 
experiences related to VR came into existence which required combinations of real and virtual world possibili- 
ties. Mixed Reality can be considered as a range of experiences existing between the completely virtual or real 
extremes of the spectrum. The derivatives of Mixed reality can be augmented forms of the real world by virtual 
elements (Augmented Reality) or augmented forms of the virtual world by real elements (Augmented Virtuality). 


« Augmented Reality: 

Augmented Reality can be defined as the experience of actually being present in a real world which is enriched by 
the virtual entities which are augmented on it with the help of a system. On contrary to the VR experience, here, 
the reality itself is modified by integrating desired virtual elements into it which opens up various possibilities of 
interaction. 
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Nintendo Virtual Boy Oculus Rift 
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1. What is Virtual Reality? Fig 1. Timeline for Evolution of Communication Media [2] 
; ; ; Image Source: Article - Evoked Reality 
2. Evolution of VR 


2a. Communication Media 

2b. Stereoscopy 1. The Era of Paintings 

2c. First Flight Simulator The evidence for the endless quest of humanity to abstract information available from the real world and to 
reproduce it as visual explorations can be traced back to the prehistoric era. Cave paintings can be considered as 


2d. Cinerama the initial efforts of human beings to recreate the physical world around them and represent them in a virtual 
2e. Sensorama Simulator form, with the help of very basic resources that were readily available around them. The most common elements 
of Telesphere Mask depicted in these paintings comprised of animal figures, human figures or parts of human forms, and abstract 
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Vi rtual Rea Ity: Introduction into paintings. In Europe (12th to 13th century AD), artists started using the medium of Frescoes to decorate the 
interior of churches. The round wall inside churches was decorated with long strips of paintings, depicting the 


10 


An Introduction to Virtual Reality 


by a a life and miracles of Christ and other saints for the purpose of edification. Another noteworthy example is that 
Azif Ismail with Prof. Jayesh S. Pillai of The Sistine Chapel ceiling painted by Michelangelo in the early 16th century. This renowned artwork of renais- 
IDC, IIT Bombay sance era enriched the interior of the church with depictions from the holy book of Genesis. The mesmerizing 


form and aesthetics of these artworks often provoked the viewers to transform themselves into a spiritual realm, 
which, by its true nature is experiencing VR itself. 
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Azif Ismail with Prof. Jayesh S. Pillai Louis Daguerre, a theater screen painter from France, worked with Niepce for further development of the tech- 

IDC, IIT Bombay nology and to reduce the technical hindrances like long exposure time. In 1838, Daguerre became successful in 
developing a photographic image of the street view from the window of his studio. This image is considered as 
the first photograph to feature people in it. 
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3. Motion Picture 

In 1879, an American photographer Eadweard Muybridge conducted an interesting experiment on spontane- 
ous photography. Muybridge arranged a setup of 12 cameras in series, along a race track with threads across to 
operate the shutters of the cameras. Through this experiment which produced instantaneous photographs in a 
sequence exposing the racehorse in its gallop. Later, when he copied silhouettes of these images into a rotatable 
disc, it induced an illusion of motion through sequential movement of these still images. Though the concept 

of moving images was exploited earlier in the form of devices like Phenakistoscope and Zoetrope, Muybridge’s 
experiment stands significant in leading light to further developments of motion pictures. 
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Fig 6. The Horse in Motion by Eadweard Muybridge 
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Aniiverecuciien eo Wrruial Reale images outside a studio setup. The first recorded footage was an outdoor shot showing some workers leaving 
Ee aeeee er eee ieee eee) the Lumiére factory. The initial public screening of Lumiére’s films was held at the Grand Café in Paris including 
by a a ten short films recorded and projected by the Cinematograph including Workers Leaving the Factory and LAr- 
Azif Ismail with Prof. Jayesh S. Pillai rivée d’un Train en Gare de La Ciotat (The Arrival of a Train at La Ciotat Station). A popular myth revolving around 
IDC, IIT Bombay the screening is that the spectators were undergoing a state of panic, deceived by the images of the onrushing 
locomotive which appeared to come out of the screen. The ability of moving pictures to capture and show life as 
it creates an unimaginable sense of reality in the viewers. The viewers succumbed themselves to the overwhelm- 
ing realism suggested by the camera, unable to distinguish between the reel and real. 
Source: 
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Stereoscopy 


Human vision or the way in which we visually perceive things is a complex process. Our brain acts much like a 
sensor for the photographic lens to process the information gathered by the eyes to formulate the visual image- 
ry. During the process, the brain uses different kinds of visual cues (perspective, scale, overlapping of objects), to 
assess the relative distance of the object from the viewer and its dimensional depth. The disparity in perspective 
between objects seen separately through left and right eye is the paramount feature that creates an illusion of 
depth. Stereoscopy is the process by which an illusion of depth is created in a flat image (photograph or a paint- 
ing), by presenting slightly different images to the left and right eyes, making the experience similar to how we 
see things in reality. 


1. Wheatstone Stereoscope 

In 1828, Sir Charles Wheatstone invented the earliest type of stereoscopes which consisted of a pair of mirrors, 
each set at an angle of 45 degrees to the viewer's eyes, reflecting two slightly different images for the left and 
right. 


Fig 1. Charles Wheatstone Mirror Stereoscope 
Image Source 
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2. Brewster Lenticular Stereoscope 

David Brewster implemented the idea of using lenses to view dissimilar images as one creating the illusion of 
depth. The relatively smaller, handheld lenticular stereoscope thus developed came to be known as Brewster 
Stereoscope. 


Fig 2. Brewster Lenticular Stereoscope 
Image Source 
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Azif Ismail with Prof. Jayesh S. Pillai actuating platform which replicated the actual movement patterns for the trainees. 
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ama projection was conducted in 1952 with a film titled ‘This is Cinerama’. 
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An Introduction to Virtual Reality In 1960, Morton Heilig developed a stereoscopic television apparatus aimed for individual use in a portable form 
by factor which could be attached to the user’s head. The Telesphere mask comprised of optical units, television 
Azif Ismail with Prof. Jayesh S. Pillai tube units, earphones, and discharge nozzles designed as a personalized device which could be adjusted to the 
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head mounted display system with three-dimensional tracking capabilities called Sword of Damocles. The setup 
consisted of stereoscopic display system displaying an output from a computer program which updated itself 
according to the movements of the user. 
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Azif Ismail with Prof. Jayesh S. Pillai HMD. Jaron Lanier is believed to be the visionary who coined and popularized the term “Virtual Reality” through 
IDC, IIT Bombay the media, creating awareness among the masses. 


Source: 
https://www.dsource.in/course/virtual-reality- 
introduction/evolution-vr/visual-programming-lab- 
research-vpl 


1. What is Virtual Reality? 
2. Evolution of VR 
2a, 2b, 2c, 2d, 2e, 2f, 2g 
2h. LEEP Display 
2i. Visual Programming Lab Research 
(VPL) 
2). Virtuality Gaming System 
2k. Cave Automatic Virtual 
Environment 
2I. SEGA VR Goggles 
2m, 2n, 20, 2p, 2q, 2r, 2s 
3. Applications of VR 
4. References 
5. Resources 


6. Video Fig 1. Data Glove by VPL 
7. Contact Details Image Source 


D’source 


Digital Learning Environment for Design - www.dsource.in 


Design Course 

Virtual Reality: Introduction 
An Introduction to Virtual Reality 

by 

Azif Ismail with Prof. Jayesh S. Pillai 

IDC, IIT Bombay 


Source: 


2i. Visual Programming Lab Research 
(VPL) 


ae! 
Fig 2. Demonstration of Eyephone HMD by VPL 


25 


D’source 


26 
Digital Learning Environment for Design - www.dsource.in _ °°» 


Design Course 


Virtual Reality: Introduction 
An Introduction to Virtual Reality 

by 

Azif Ismail with Prof. Jayesh S. Pillai 

IDC, IIT Bombay 


Source: 
https://www.dsource.in/course/virtual-reality- 
introduction/evolution-vr/virtuality-gaming-system 


1. What is Virtual Reality? 
2. Evolution of VR 
2a, 2b, 2c, 2d, 2e, 2f, 2g 
2h. LEEP Display 
2i. Visual Programming Lab Research 
(VPL) 
2). Virtuality Gaming System 
2k. Cave Automatic Virtual 
Environment 
2I. SEGA VR Goggles 
2m, 2n, 20, 2p, 2q, 2r, 2s 
3. Applications of VR 
4. References 
5. Resources 
6. Video 
7. Contact Details 


Virtuality Gaming System 


Addressing the increasing popularity of VR among the common people, the British company W Industries devel- 
oped a community space VR gaming system called Virtuality in 1991. The multiplayer setup consisted of real time 
stereoscopic renderings viewed through a head mounted display with handheld joysticks. 


Fig 1. An Advertisement for Virtuality 
Image Source 
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An Introduction to Virtual Reality In 1992, the CAVE system was demonstrated as an immersive VR environment which was based on the principle 
by of wrapping up the entire field of view of the user with stereoscopic images forming a virtual cave around. The 
Azif Ismail with Prof. Jayesh S. Pillai users equipped with stereoscopic glasses could submerge themselves in the visual representations, projected to 
IDC, IIT Bombay the walls of the cave which were updated to align with his/her perspective. CAVE system was developed by Caro- 


lina Cruz-Neira, at the University of Illinois, Chicago Electronic Visualization Laboratory. 
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SEGA VR Goggles 


Sega launched its VR headset dubbed as Sega VR in 1993 advertised as the future of gaming with the added 
dimension of immersivity. The device incorporated cutting edge technologies like LCD screens for vision, head 
movement tracking, and stereo headphones to provide an immersive gaming experience. However, the product 
failed to gain popularity among the users because of the ergonomic issues. 


Fig 1. Sega VR Headset 
Image Source 
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An Introduction to Virtual Reality The Virtual Boy, a portable gaming console was launched by Nintendo in 1995. It was marketed as the first 

by gaming system capable of displaying stereoscopic graphics. The display of the Virtual Boy was based on red LED 
Azif Ismail with Prof. Jayesh S. Pillai eyepiece reflexive technology which made it monochrome. The controller which came along allowed the users to 
IDC, IIT Bombay interact with the graphical world. However, the innovation didn’t pay off well for the developers as it ended up as 


one of the lowest selling products of Nintendo. The lack of colours in the display and the ergonomic issues with 
the optics pulled back the customers from this unique adventure. 
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Virtual Reality: Introduction 

An Introduction to Virtual Reality Oculus Rift which revolutionized the VR head mounted display was launched as a Kickstarter crowdfunding cam- 
by paign by Palmer Luckey after the formulation of his company Oculus VR in 2012. The first developer kit launched 
Azif Ismail with Prof. Jayesh S. Pillai after a year envisioned a consumer level head mounted display that was way ahead of its predecessors with 
IDC, IIT Bombay better ergonomics and build. The latest versions of Oculus Rift are equipped with precise head position tracking 


capabilities and better controller accessories. 
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An Introduction to Virtual Reality Google Cardboard is a platform developed by Google engineers David Coz and Damien Henry as a low cost 
by solution for experiencing VR content. The basic housing of the device is a cardboard cutout which incorporates a 
Azif Ismail with Prof. Jayesh S. Pillai couple of lenses and a slot for attaching a mobile phone. The lens components enables stereoscopic view of the 
IDC, IIT Bombay visual content displayed on the phone. The users were encouraged to make their own cardboard viewers with the 


instructions provided by the developer. The much grounded innovation from Google which was launched in 2014, 
paved way for the development of similar head mounted displays which made use of a mobile phone to render 
images. 
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Fig 2. Google Cardboard fully unfolded 
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Virtual Reality: Introduction 

An Introduction to Virtual Reality HTC Vive is a room scale device setup developed by the collaborative efforts of HTC and Valve Corporation. The 
by Vive package consists of a head mounted device with a high resolution stereoscopic display, base stations which 
Azif Ismail with Prof. Jayesh S. Pillai incorporate infrared light emissions for precise position tracking and controllers with embedded sensors for 
IDC, IIT Bombay physical interactions. The display requires a computer with a powerful Graphical Processing Unit to render the 


visual representations of the constantly updated virtual world. The device was officially launched by HTC in Feb- 


ruary 2015. 
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360 Video 


The efforts to capture or record the entire field of view of the space around resulted in obtaining spherical videos 
of which the field of view can be controlled by the user during the time of playback. The technology of wides- 
creen cinematic views like that of Cinerama can be considered as the forerunners of 360 degree videos where 
multiple cameras were used to record content simultaneously. 360 degree videos are recorded using a rig made 
of multiple cameras facing each direction and then stitching together the individual videos into a single one. The 
multiple camera rigs are now replaced by single camera units which are equipped with multiple lenses facing 
each direction. 


Fig 1. Gopro Omni 360 Monoscopic Multiple Camera Rig 
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Fig 2. Ricoh Theta 360 Monoscopic Camera 
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An Introduction to Virtual Reality An underlying commonality of both HTC Vive and Oculus Rift is the inevitable dependency on a computer to ren- 
by der images for it. Although these devices have gained popularity among the developers and VR enthusiasts, the 
Azif Ismail with Prof. Jayesh S. Pillai high pricing and conditional portability pull them back from being consumer friendly. Catering to these issues, 
IDC, IIT Bombay both HTC and Oculus are coming up with standalone Head mounted displays which rather depend on an inbuilt 


processing unit to render the virtual world. These devices have the advantages of being untethered or unbound 
to other hardware components in the system which gives the user more freedom of movement. 
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Fig 2. HTC Vive Focus 
Image Source 


Sie, 


D’source 


40 


Digital Learning Environment for Design - www.dsource.in .- 

oo VR and Prospects 

Virtual Reality: Introduction 

An Introduction to Virtual Reality Engineers, designers and developers all around the globe continue the efforts to manifest the immense poten- 
by tial of virtual reality technology catering to various possibilities. The boundaries which distinguish virtual reality 
Azif Ismail with Prof. Jayesh S. Pillai from related technologies like augmented reality are diminishing, leading to the emphasis on a broader canvas 
IDC, IIT Bombay of mixed reality technology. Leading tech-companies like Microsoft, Google and Apple are developing aug- 


mented reality systems and software applications which are readily available for public consumption. Microsoft 
developed Hololens, ahead mounted device which can augment 3D content on our surrounding real world view. 
Startup ventures like Magic Leap and Avegant are currently working on devices which use light field technology 
for experiencing mixed reality applications. 
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Applications of VR 


VR provides an intuitive way of human computer interaction where the user can involve and interact with the 
simulated reality in the same way he/she behaves with the real world. The applications of VR stretch over multi- 
disciplinary fields and sectors of Design, Architecture, Tourism, Entertainment etc. 


1. Design and Architectural Visualization 

A huge amount of gathered information is associated with any kind of research and study methodologies. The 
primitive goal of data visualization techniques is to develop some visual representations out of these in order to 
make them perceptible and easily accessible to the users. 


VR can be used as an intuitive medium to where the users can assess the information and interact to the visu- 
alizations. The feeling of physical presence and sense of space makes VR effective in experiencing architectural 
walkthroughs and virtual tourism. Modelling of three-dimensional objects in real time is another application of 
VR systems. 


2. Medical Applications 

VR can be used for the treatment of patients with mental disorders of phobia. The users are allowed to confront 
their fears in a controlled environment which is otherwise impractical to achieve in a real scenario. It is also used 
as a meditation technique for overcoming stress and anxiety. Intuitive, alternative therapies based on VR are 
nowadays used for mental and physical rehabilitation [5]. 


3. Training and Simulation 

Industries like aviation and mining require effective methodologies to practically train their professionals for 
getting acquainted with the technicalities involved. The high stakes of risk and capital involved make these mock 
training exercises inevitable. First such applications of VR were explored in the form of flight simulators which 
helped the pilots to overcome practical difficulties. VR systems are nowadays used for training of surgeons, min- 
ing workers, soldiers etc. 


4. Tele Operation 

Tele Operation is the technology which allows conducting remote operations without being physically present in 
the actual space. VR can be used to achieve possibilities of teleoperation where the user can carry out operations 
remotely from a controlled space using a remote control system. VR seems to be the only effective solution when 
the distant environment is hazardous to human life or impractical to work (Remote bomb diffusion, Remote 
astronomic explorations) [6]. 
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5. Entertainment 


Entertainment is the domain which effectively brought VR to the masses. The added dimension of immersion 
achieved through VR games makes the collaboration tailored for the purpose of entertainment. Storytelling in 
VR is being explored in the form of 360 videos which is now gaining popularity. 


6. Education 

Education is another domain which can make use of VR technology to enhance the effectiveness of teaching and 
learning. Virtual environments can be a better way of representation of information to the students as they pro- 
vide the possibility of understanding through interaction. Virtual field trips (museums, historic sites), Simulation 
based training (Medical students) are some of the methodologies that are being implemented today. VR can also 
be used for education sector catering to those with special needs. 


7. Performing Arts 

VR redefines the possibilities of performance based artists by adding attributes of interactivity. Wearable acces- 
sories are effectively used by the artists to enhance the experience delivered through simulations which interact 
with them in the desired manner. 
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Resources 


Web Links: 


¢ Virtual Reality - Historical Overview - Cave, Research, Experience, and Computer 
http://science.jrank.org/pages/11561/Virtual-Reality-Historical-Overview.html 


¢ The sights and scents of the Sensorama Simulator 
https://www.engadget.com/2014/02/16/morton-heiligs-sensorama-simulator/ 


¢ Virtual Realities Then and Now: The Caves of Lascaux 
http://www.transparencynow.com/lascaux.htm 


¢ Virtual and Augmented Realities: Asking the right questions and traveling the path ahead 
https://medium.com/@claybavor/virtual-and-augmented-realities-asking-the-right-questions-and-traveling-the- 
path-ahead-2428b9d13c01 


* Forgotten genius: the man who made a working VR machine in 1957: A Gear VR from the 1950s? 
http://www.techradar.com/news/wearables/forgotten-genius-the-man-who-made-a-working-vr-machine- 


in-1957-1318253/2 


* Unraveling The Enigma Of Nintendo's Virtual Boy 
https://www.fastcompany.com/3050016/unraveling-the-enigma-of-nintendos-virtual-boy-20-years-later 


¢ Nolan Bushnell with VPL EyePhone and Larry Wall Nomadic Research Labs 
https://microship.com/nolan-bushnell-vpl-eyephone-larry-wall-1988/ 


¢ A Brief History of Oculus 
https://techcrunch.com/2014/03/26/a-brief-history-of-oculus/ 


Original Video Source: 


¢ Sega VR Demonstration 
www.youtube.com/watch?v=yd98RGxadOU 


* History of VR (Cnet) 
www.youtube.com/watch?v=hDWfsIbBtwE 
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5. Resources 


¢ The Arrival of a Train at La Ciotat Station 
* Morton Heilig’s Sensorama Interview 

¢ The Sword of Damocles 

¢ lvan Sutherland: Sketchpad Demo 


Videos Links: 


¢ Sega VR Demonstration 
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¢ The Arrival of a Train at La Ciotat Station 
Varrivée d’un train a La Ciotat (1895) - fréres Lumiére 
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